An Alternative Coding Theorem for Posterior Matching via Extrinsic Jensen–Shannon Divergence
نویسندگان
چکیده
This paper considers the problem of coding over a discrete memoryless channel (DMC) with noiseless feedback. The paper provides a stochastic control view of a variable-length version of the posterior matching scheme which is analyzed via a recently proposed symmetrized divergence, termed Extrinsic Jensen–Shannon (EJS) divergence. In particular, under the variable-length posterior matching scheme, the EJS divergence can be lower bounded by the Shannon capacity of the DMC, which can be used for a relatively simple proof that the variablelength posterior matching scheme achieves capacity.
منابع مشابه
Extrinsic Jensen-Shannon Divergence: Applications to Variable-Length Coding
Abstract—This paper considers the problem of variable-length coding over a discrete memoryless channel (DMC) with noiseless feedback. The paper provides a stochastic control view of the problem whose solution is analyzed via a newly proposed symmetrized divergence, termed extrinsic Jensen–Shannon (EJS) divergence. It is shown that strictly positive lower bounds on EJS divergence provide non-asy...
متن کاملDiscrimination Measure of Correlations in a Population of Neurons by Using the Jensen-Shannon Divergence
The significance of synchronized spikes fired by nearby neurons for perception is still unclear. To evaluate how reliably one can decide if a given response on the population coding of sensory information comes from the full distribution, or from the product of independent distributions from each cell, we used recorded responses of pairs of single neurons in primary visual cortex of macaque mon...
متن کاملDivergence Measures for Dna Segmentation
Entropy-based divergence measures have shown promising results in many areas of engineering and image processing. In this study, we use the Jensen-Shannon and Jensen-Rényi divergence measures for DNA segmentation. Based on these information theoretic measures and protein shape coded in DNA, we propose a new approach to the problem of finding the borders between coding and noncoding DNA regions....
متن کاملApproximate solutions of homomorphisms and derivations of the generalized Cauchy-Jensen functional equation in $C^*$-ternary algebras
In this paper, we prove Hyers-Ulam-Rassias stability of $C^*$-ternary algebra homomorphism for the following generalized Cauchy-Jensen equation $$eta mu fleft(frac{x+y}{eta}+zright) = f(mu x) + f(mu y) +eta f(mu z)$$ for all $mu in mathbb{S}:= { lambda in mathbb{C} : |lambda | =1}$ and for any fixed positive integer $eta geq 2$ on $C^*$-ternary algebras by using fixed poind alternat...
متن کاملA quantum Jensen-Shannon graph kernel for unattributed graphs
In this paper, we use the quantum Jensen–Shannon divergence as a means of measuring the information theoretic dissimilarity of graphs and thus develop a novel graph kernel. In quantum mechanics, the quantum Jensen–Shannon divergence can be used to measure the dissimilarity of quantum systems specified in terms of their density matrices. We commence by computing the density matrix associated wit...
متن کامل